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® Method of storing and transmitting image data as image file suitable for image search. 



@ The image fife (IFt) consists of a file header 
(FH). a reduced and compressed image data, and a 
compressed original Image data. The reduced and 
compressed image data is obtained by compressing 
a reduced image data expressing a reduced image 
of an original image in serial order of bit planes. The 
reduced image Is then reproduced and displayed on 
an image display for image search, in place of the 
original image itself, whereby efficiency in the image 
search is improved. 
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Method of Storing and Transntitting Image Data as Image RIe Suitable for Image Search 



BACKGROUND OF THE INVENTION 



larger than the size of an ordinary display device. 



Reld of the Invention 



SUMMARY OF THE INVENTION 



The present invention related to a method of 
storing and transmitting an image data, and more 
particularly to an image data format suitable for 
image search using an image display. 



Description of the Background Arts 

In general, an original image data obtained by 
reading an original is stored or transmitted in the 
form of an image file in which the original image 
data follows a file header. An example of such an 
image file IFm is illustrated in Rg. 1 and the fiie 
header includes information for identifying the filed 
image. 

When the amount of the original image data is 
very large, the original image data is often com- 
pressed through a data compression technique and 
then filed in the form of an image file IF^ shown in 
Fig. 2, in order to reduce memory capacity re- 
quired for storing the original Image data. Image 
data requiring the data compression are classified 
into t'wo types, one of which is that expressing an 
original image of large size and the other is that 
having a fine pixel pitch. For example, about 245 
megabytes are required for storing a color image 
of A2 size under pixel pitch of 160 pixels/cm, as a 
total capacity for color coriiponents of yellow (Y), 
magenta (M). cyan (C) and black (K). By means of 
the data compression, the required memory capac- 
ity is reduced so that such an original image data 
can be stored in an image memory whose capacity 
is not quite large. 

However, even if an original image data is 
compressed, the amount of the original image data 
is still large, and a relatively large time is required 
for fully displaying the original image on a display 
device through serial access of the original image 
data. Therefore, when a plurality of images are 
serially displayed on a display device in order to 
find a desired original image within the plurality of 
images, a total time until the desired original image 
is found is inevitably long. Furthermore, if the re- 
spective sizes of the filed images are large, a 
display device of large size and an image buffer 
memory of large capacity must be prepared. Since 
a display device having a quite large size is not 
practical, each of the filed original images should 
be displayed part by part in the case where the 
respective' sizes of the filed original images are 



The present invention is intended for a method 
of storing an image file in a memory means which 
is provided in an image processing system having 
an image display usable for image search. 

10 According to the present invention, the method 

comprises the steps of: (1) preparing a first image 
data expressing an original image. (2) generating a 
second image data expressing a reduced image of 
said original image, size of said reduced image 

75 being equal to or smaller than display size of said 
image display, (3) producing a file header including 
an identification data for identifying said image file, 
and (4) storing a combination said file header, said 
first image data and said second image data in 

20 said memory means as said image file. 

The reduced image is displayed on the image 
display for the image search. Since the size of the 
reduced image is equal to or smaller than the 
display size of the image display, the whole of the 

25 reduced image can be displayed on the image 
display. Consequently, the image search is easily 
attained as compared with the case where the 
original image itself is displayed. The storage ca- 
pacity of a display buffer memory may be small. 

30 because the data amount of the reduced image is 
less than that of the original image. Furthermore, 
time and cost required for the image search is 
decreased, so that efficiency in the image search is 
improved. 

35 Preferably, the second image data is a reduced 

and compressed image data obtained by com- 
pressing a reduced image data expressing the re- 
duced image for each pixel. The data compression 
may be conducted in serial order of bit planes. In 

40 the preferred embodiment, a run-length coding rule 
is applied to the data compression. In order to 
further save the storage capacity, the first image 
data may be prepared by compressing an original 
image data expressing the original image for each 

45 pixel. 

The present invention may be also applied to a 
method of transmitting the image data. The image 
file including the combination of the file header, the 
first image data and the second image data is 
50 transmitted to another image processing system 
having an image display. 

Preferably, the second image data expressing 
the reduced image is transmitted prior to the first 
image data expressing the original image. An oper- 
ator or user can observe the reduced image on the 
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image display in order to find whether the transmit- 
ted image file is a desired one or not. When the 
second image data is that expressing the reduced 
image in serial order of bit planes, the gradation of 
the reduced image being displayed becomes fine 
step by step. If the operator finds that the dis- 
played image is not a desired image, the operator 
inputs a cancellation command in order to stop or 
cancel the data transmission of the remaining part 
of the image file. Apparatus useful for the present 
method Is also provided in the preferred embodi- 
ment. 

Accordingly, an object of the present invention 
is to provide a method of storing or transmitting an 
image file in the form suitable for image search. 

Another object of the present invention is to 
save a storage capacity of a display buffer mem- 
ory- 
Further another object of the present invention 
is to save time and cost required for image search 
or image retrieval. 

These and other objects, features, aspects and 
advantages of the present invention will become 
more apparent from the following detailed descrip- 
tion of the present invention when taken in conjunc- 
tion with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 and Rg. 2 show conventional image 

files. 

Rg. 3 is a block diagram showing an image 
communication system according to a preferred 
embodiment of the present invention; 

Rg. 4A shows an image file according to the 
preferred embodiment. 

Fig. 4B shows the details of a file header 
included in the image file shown in Rg. 4A. 

Rg. 5 is a block diagram showing the func- 
tion of an image bank, 

Rg. 6 is a block diagram showing the func- 
tion of an image terminal, 

Rg. 7A shows the respective sizes of an 
original image and a display plane. 

Rg. 78 is an explanatory diagram showing a 
reduction process, 

Rg, 8 A shows a pixel array on the original 
image, where white squares or pixels are skipped 
for image reduction, 

Rg, 88 and Fig. 80 show examples of the 
reduced image. 

Fig. 9A is a schematic diagram showing a bit 
hierarchy consisting of bit planes, 

Rg. 98 is a schematic diagram showing the 
first bit plane consisting of respective most signifi- 
cant bits of the original image data. 



Rg. 10 shows the details of the image file 
shown in Fig. 4A, 

Fig. 11 is a graph showing gradation ex- 
pressed by the more significant three bits, 
5 Rg. 12 shows displayed images, where gra- 

dation becomes fine step by step in the order, from 
Fig. 12A to Rg. 12E, and 

Fig. 13 through Rg. i8 show image files 
according to other preferred embodiments of the 
ro present invention. 



DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

15 

A. Hardware Structure 

Rg. 3 is a block diagram showing an image 

20 communication system 100 according to a pre- 
ferred embodiment of the present invention. The 
system 100 comprises an image bank IB for filing 
an original image data therein, and an image termi- 
nal TM to which the original image data and other 

25 data are transmitted from the image bank IB 
through an image transmission path 40. As will be 
described later, the data transmitted through the 
path 40 are encoded data and the image terminal 
TM decodes the encoded data. Although only one 

30 terminal TM is illustrated in Rg. 1, a plurality of 
image terminals may be coupled to the image bank 
IM through the image transmission path 40. The 
image bank IB is placed in a data production room, 
while the image terminal TM is placed at a user's 

35 side. The image transmission path 40 may be a 
public telephone line, a dedicated digital commu- 
nication line, an optical signal line or the like. 

The image bank IB has an image memory 4 for 
storing the original image data in the form of an 

40 image file, which may be a magnetic disc. A ROM 
2 and a RAM 3 are provided in the image bank IB 
for storing an operation program for CPU 1 and 
other data The image bank IB has two buffer 
memories 5 and 7. The buffer memory 5 is pro- 

45 vided for buffering color component data of Y, M. C 
and K in an image filing process. The other buffer 
memory 7 is coupled to a monitor display 9 
through a display controller 8, and is operable to 
buffer an image to be displayed. The monitor dis- 

50 play 9 may be a color CRT having an arbitrary 
size. A keyboard 6 is connected to the CPU 1 for 
manually inputting commands and various data. 

The image terminal TM has similar structure to 
the image bank IB. and comprises a CPU 21, a 

55 ROM 22. a RAM 23 and an image memory 24. A 
buffer memory 25 for color components of Y, M, C 
and K and another buffer memory 27 for a monitor 
display 29 are also provided in the image terminal 
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TM. The monitor display 29 may be a color CRT 
having an arbitrary size, and is controlled by a 
display controller 28. The function of the CPU 21 is 
different from that of the CPU 1 provided in the 
image bank IB, as wilt be understood later. 



B. Overail Operational of image Communication 
System 

The image communication system 100 oper- 
ates as follows: Rrst. an original image data ex* 
pressing an original image for each scanning line is 
inputted to the image bank IB. An identification 
data for identifying an image file ot be produced is 
also inputted to the image bank IB. The image 
bank 16 transforms the original image data into a 
reduced image of the original image. The reduced 
image data is subjected to data compression, 
whereby a reduced and compressed image data is 
obtained. The identification data is combined with a 
value expressing the size of the reduced image 
and another value indicating the toral amount of the 
reduced and compressed image data, whereby a 
file header FH shown in Rg. 4A and Rg. 4B is 
produced. 

Then, the original image data is subjected to 
another data compression, to become a com- 
pressed original image data. The file header, the 
reduced and compressed image data, and the 
compressed original image data are stored in the 
image memory 4 in the form of an image file IFi 
shown in Rg. 4A. 

The image file IFt can' be transmitted to the 
image terminal TM through the transmission path 
40 to be stored in the image memory24. Search for 
a desired original image is also attained by display- 
ing the reduced image on the monitor display 29. 

Fig. 5 is a block diagram showing a part of the 
image bank IB as a combination of function blocks. 
Means 11-18 are embodied with the function of 
the CPU 1. Similarly, a part of the image terminal 
TM is illustrated in Rg. 6. where means 32 - 36 are 
embodied with the function of the other CPU 21. 

In the following sections, the respective pro- 
cess steps for attaining the above indicated opera- 
tion will be described in detail along the process 
sequence, with reference to Rg. 3 - Rg. 6. 



C. Image Data Rling 



^c-1) Input of Original Image Data and identification 
Data 

Referring to Rg. 5, the original image data 
expressing the original image for each color com- 
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ponent (Y. M. C and K) is inputted to the image 
bank IB through input means (not shown) such as a 
color image scanner. The original image data has 
eight bits per pixel for each color component Y. M. 

5 C and K. whereby the color density or gradation 
level on each pixel is expressed within 2^ - 256 
levels. The original image data is stored in the 
image memory 4. 

Then, an operator inputs the identification data 

TO through the keyboard 6. where the identification 
data may include an image file name, a file num- 
ber, the size of the original image, a filing date, and 
other information useful for identifying the image 
file to be produced. A file header generating means 

75 11 (Rg. 5) receives the identification data and then 
arranges the identification data to thereby generate 
tiie file header FH shown in Rg. 5B. The file 
header FH is stored in the image memory 4, where 
the "size of the reduced image" and the "total 

20 amour compressed image data" shown in Rg. 
SB have not been specified in the file header FH 
yet. 



25 (c-2) Generation of Reduced Image 

In order to fit the size of the reduced image to 
that of the monitor display 9 or 29. an image 
reduciton means 12 (Rg. 3) determines a reduction 
30 ratio as follows; Rrst. the respective minimum in- 
tegers ix and Iy satisfying tiie conditions; 
Ix-MxSLx (1) 
Iy'My^Ly (2) 

are calculated, where, as shown in Rg. 7A. 

35 Mx. My: the size of the display plane 70 of the 
monitor display 9 or 29 in the main scanning direc- 
tion X and the subscanning direction Y, the direc- 
tions X and Y being defined according to image 
scanning for display, and 

40 Lx. Ly: the size of the original image 50 in the 
directions X and Y. 

Then, the larger one of the integers Ix and Iy is 
selected to determine an integer 1m. i.e., 
Im = MAX [ Ix, Iy ] (3) 

45 As understood from the expressions (1)-(3). the 

integer Im is the minimum integer satisfying both of 
the conditions; 
Im-Mx^Lx (4) 
Im-MySLy (5) 

50 The inverse of the integer Im is employed as 

the reduction ratio, whereby whole of the reduced 
image 51 (Fig. 7B) can be displayed on the side of 
tine display plane 70 without a wide margin. In 
other words, the size of the reduced image 51 is 

55 equal to or slightly smaller than that of the display 
plane 70. In the preferred embodiment, a standard 
value for the reduction ratio is set at "1/8". Only 
when the reduction with the reduction ratio "1/8" is 
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insufficient to display the reduction Image on the 
display plane, the reduction ratio is forced to be 
i.e., 

1/R (Reduction Ratio) = MIN [1/Im. 1/8] (6) 

This is because the si2e of the original innage 
is often eight times the size of a standard monitor 
display, and the standard value "1/8" is suitable for 
many of original images. The value of the reduction 
ratio 1/R is stored in a register (not shown). 

The reduction ratio may be determined accord- 
ing to only one of the integers Ix and W. If respec- 
tive shapes of the original image 50 and the dis- 
play plane 70 are squares, the reduciton ratio ac- 
cording to one of Ix 3nd Iy is the same with that 
determined through expressions (1)-(6). Even if the 
integers Ix and Iy are different from each other, the 
reduciton ratio according to one of Ix and Iy can be 
employed. This is because the reduced image is 
mainly used for finding a desired image within a 
plurality of filed images, and the reduced image 
may be displayed with its minor part being out of 
the display plane 70 in one of the directions X and 
Y. 

In order to generate the reduced image, the 
original image data is read-out from the image 
memory 4 while being skipped every R pixeis by a 
read/write control means 12 (Rg. 5) in both of the 
main scanning direction X and the subscanning 
direction Y. .If a pixel array corresponding to the 
original image 50 has the structure shown Rg, 8A 
and the reduction ration 1/R is "1/10". the pixels 
other than the pixels 61 indicated with slanted lines 
are skipped and the reduced image data express- 
ing the reduced image is generated. Rg. SB shows 
a pixel array expressing the reduced image 51, 
where the pixels indicated with slanted lines in Rg. 
8B correspond to those illustrated in Rg. 8A. If the 
reduction ratio 1/R is "1/8". the pixeis other than 
the pixeis 82 indicated with dots are skipped, 
whereby the reduced image 51 shown in Rg. 8C is 
generated. 

Through the skipping process, the amount of 
image data is reduced by a factor of (l/R^). Since 
the upper limit of the reduction ratio 1/R is set at 
"1/8", the reduction factor (l/R^) in data amount is 
smaller than (1/82) = 0.015625 (about 1,6 per- 
cents). Therefore, memory capacity required for 
storing the reduced image 51 is quite smaller than 
that for the original image 50 itself. 

The image reduction may be conducted with 
another method. For example, each pixel on the 
reduced image 51 may be obtained by taking an 
average of the original image data for each cluster 
having R^ (i.e., two or more) pixels. The average 
may be a weighted average. If the weight for the 
weighted average is "1" for every R-th pixels along 
the X(Y) direction and is "0" for other pixeis, the 
weighted average is just the pixel skipping de- 



scribed at50ve. Furthermore, when the original im- 
age data is a gradation data such as the present 
case, the less significant bits may be deleted in the 
reduced image in order to further decrease the 
5 amount of data. 

The reduced image data for Y, M. C and K 
colors thus obtained are delivered to buffer memo- 
ries 5Y-5K (Rg. 5) to be temporarily stored therein, 
respectively. 



(c-3) Data Compression of Reduced image 

The reduced image data consists of color com- 

75 ponents of Y, M, C and K. each of color compo- 
nents being expressed by 8 bits for each pixel. Rg. 
9A is a schematic diagram showing a bit. hierarchy 
of the Y-component in the reduced image, where 8 
bit data Byi-Bys for each pixel are illustrated as 

20 cubic cells stacked up in the vertical direction. The 
cubic cells are also arrayed in the horizontal direc- 
tion according to the pixel array in the reduced 
image. The lowest plane BPyi consisting of the 
most significant bits (MSB) 8yi for respective pix- 

2S els is "a first bit plane", while the plane BPyj 
consisting of J-th significant bits Byj for respective 
pixels is "an J-th bit plane". Rg. 9B shows the first 
bit plane extracted from the bit hierarchy. Since the 
most significant bit Byi through the least significant 

30 bit Yv3 are stacked in that order, a rough level in 
image gradation is expressed by a lower bit plane, 
while a fine level is expressed by a higher bit plane 
in the bit hierarchy. The bit hierarchy formed by 
the bit planes can be defined also for each of other 

35 color components M, C and K. 

Referring to Rg. 9 and Rg. 5, the most signifi- 
cant bits Yyn for respective pixels belonging to a 
first main scanning line Li (Rg. 9B) are read-out 
from the buffer memory 5Y along the pixel align- 

40 ment. The most significant bits Byi are delivered in 
series to an encoder means 14Y. which is included 
in a data compression means 14 together with 
other encoder means 14M-14K. The encoder 
means 14Y is operable to encode the sequence of 

45 the most significant bits Byi into a set of run-length 
codes, to thereby compress the data amount of the 
most significant bits Byi in the first scanning line 
Li. The reduced and compressed image data Oyi-t 
thus obtained is transmitted to the image memory 

50 4 and is stored in an address next to the file 
header FH. as shown in Rg. 10. under the control 
with a filing control means 16. 

The similar process steps are repeated also for 
M. C and K colours, whereby the reduced and 

55 compressed image data Omli. Oci i ^nd Oki.i for 
the first scanning line Li are generated on the 
basis of the bit values provided in the first bit 
planes of respective colors. The reduced and com- 
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pressed image data Dyvi through Dki.i are stored 
in the image memory 4 as a part of the image file 
IF: as shown in Fig. 10. 

The above-indicated process is repeated ac- 
cording to the multi-repetition loop consisting of; s 

(a) a minor repetition loop for Y, M, C and K, 

(b) an intermediate repetition loop for the 
first through fast scanning lines, and 

(c) a major repetition loop for the first 
through eighth bit planes, io 
where the repetition control is conducted by a 
compression control means 13 (Fig. 5) operable to 
select and enable the encoder means 14Y-14K 
cyclically for Y, M, C and K components. 

The reduced and compressed image data thus ts 
obtained are stored in the image memory 4 as a 
part of the image file IFi. As shown in the first 
through third rows of Rg. 10, the reduced and 
compressed image data (the run-iength data or 
codes) are so arranged In the image file IFi that 20 
the run- length data Or.] are arranged in an ascent 
order fcr i and j, where: 
F (Color Index)' = Y, M. C and K. 
i (Bit Plane Index) = 1-8, and 

j (scanning Line Index) =1-512. 25 

It is to be noted that the run-length data ob- 
tained from a same bit plane are gathered to form 
a sub-sequence^ and respective sub-sequences for 
the bit planes are arranged according to the bit 
hierarchy or in serial order of the t>it planes. Within 30 
each of the sub-sequences, the respective run- 
length data for the scanning lines are aligned ac- 
cording to the order of the scanning lines. For 
example, the sub-sequence for the second bit 
ptane is located at the storage area next to that for 3S 
the first bit plane, and the run-length data for the 
second scanning line U (Rg. 9B) are located in the 
area next to that for the first scanning line Lt in the 
image file IF1. End codes for designating the re- 
spective ends of the scanning lines and those of 4o 
the sub-sequences are provided at their respective 
end positions in the image file IFi . 



(c-4) Complement to Hie Header FH 45 

After the reduced and compressed image data 
are stored in the image memory 4. the CPU 1 
calcuiates the size of the reduced and compressed 
image through the equations: so 
Lqx = Lx/R (7) 
Lry = Ly/R (8) 

where Lrx and Lry are the size of the reduced and 
compressed image in the main scanning direction 
and the subscanning direction, respectively. Fur- 55 
thermcre. the CPU 1 calcuiates the total amount 
TA of the reduced and compressed image by 
summing up the respective amount of the run- 



length data The respective values indicating the 
size Lftx, Lry and the total amount TA are stored in 
the image memory 4 as a part of the file header 
FG (Rg. 4B). whereby the generation of the file 
header FH is completed. The file header FH may 
consist of 512 bytes, for example. 



(c-5) Compression of Original Image Data 

Then, the original image of data of 8 bits for Y- 
component on the first scanning line are read-out 
from the image memory 4 to be delivered to the 
buffer memory 5Y without skipping of the pixels. 
The original image data are then transmitted to an 
encoder means 17Y. and compressed therein 
through a predictive coding rule for each scanning 
line. That is, an expected value of the original 
image data for a pixel is estimated from that of the 
preceding pixel, and then the deviation from the 
expected value is calculated to be coded into an 
compressed original image data Oyi for each pixel, 
where the data length of the data Oyi is variable 
according to the result of the data compression. A 
set of the compressed original image data CDyi thus 
obtained for the first scannir^ line are delivered to 
the image memory 4, to be stored at the area next 
to the reduced and compressed image data in the 
image file IFi (Rg. 10). 

The above-Indicated process is repeated ac- 
cording to a multi-repetition loop consisting of: 

(a) a minor repetition loop for Y, M, C and K, 

and 

(b) a major repetition loop for the first 
through last scanning lines. 

where the repetition control is conducted by an- 
other compression means 18 (Rg. 5) operable to 
select and enable the coding means 17Y»17K 
cyclically for Y, M, C and K -components. 

Accordingly, the respective compressed image 
data 0F^. are arranged in the image file IFi in serial 
order of the scanning lines as shown in Rg. 10, 
where: 

F = Y, M. C and K, 

L (Scanning Line Index) = 1 - N, and 

N = the number of the scanning lines. 

It is to be noted that the number N of the 
scanning lines is that on the original image, while 
the number "512" indicated in the respective right 
ends of the first through third rows in Fig. 10 is the 
number of the scanning lines on the reduced im- 
age. Therefore, the number N and "512" are re- 
lated with each other through the expression: 
512 = N/R (9) 

As shown in Fig. 4A and Rg. 10, the image file 
IFi consists of the file header FH, the reduced and 
compressed image data, and the compressed origi- 
nal image data. Other image files for other original 
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ima^s can be produced through a similar process, 
and the image files thereof are also stored in the 
image nnemory 4. 

D. Image Data Transmission 

When it tis desired that on image file stored in 
the image memory 4 is transmitted to the image 
terminal TM. a user inputs the identification data for 
the desired image file with a keyboard 26 (Rg. 3). 
The identification data is transmitted to the image 
bank IB through the transmission path 40 under the 
control by the CPU 21. On receiving the identifica- 
tion data, the CPU 1 in the image bank IB com- 
pares the transmitted identification data with those 
of the image files stored in the image memory 4, to 
thereby find an image file having the same iden- 
tification data with that transmitted from the image 
terminal TM. 

The image file thus found is read-out from the 
image memory 4, and then, the file header FH, the 
reduced and compressed image data and the com- 
pressed original image data included therein are 
transmitted to the image terminal TM through the 
transmission path 40 in series. The order of the 
data transmission is the same with the image filing 
described above, and therefore, the data included 
in the image file are transmitted in the order shown 
in Rg. 10. 

In the present image communication system 
100. it is also possible to transmit the image file 
without a previous image filing. That is. when the 
original image data designated by the received 
designation data has not been arranged in the form 
of an image file yet. the CPU 1 starts to produce 
the reduced and compressed image data and the 
compressed original image data, and then, the pro- 
duced image data are transmitted to the image 
terminal TM without being stored in the image 
memory 4. 

In both cases, the transmitted image file is 
stored in the image memory 24 through a data 
receiver means (not shown), as a received image 
file. Alternatively, only the file header FH is stored 
in the image memory 24. while the reduced and 
compressed image data and the compressed origi- 
nal image data are stored in buffer memories 25Y- 
25K for each color component. 



E. Image Data Reproduction and Image Display 

Then, the file header FH is read-out from the 
image memory 24 through a read/write control 
means 32. The respective data indicating the origi- 
nal image size, the reduced image size and the 
toral amount of the reduced and compressed im- 
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age data are extracted from the file header FH, to 
be stored in a register (not shown). The read/write 
control means 32 read-out the YMCK components 
Dyi.i - Dki-i of the reduced and compressed image 
5 data from the image memory 24, where the com- 
ponents Dyi-i - Dki-i are those for the first scanning 
line in the first bit plane. The respective ends of the 
components Dyi-i - Dki-i can be recognized by 
detecting the respective end codes following them. 

10 The components Dyi-i * Dki-i ^''e Stored in the 
buffer memoried 25Y-25K. respectively. 

A image data reproduction means 34 com- 
prises a set of decoding means 34Y-34K for YMCK 
colors, which are cyclically selected and enabled 

T5 by the data reproduciton control means 33. The 
decoding means 34Y receives the data Dyi-i for Y- 
component, and reproduces the reduced image 
data on the first scanning line in the first bit plane 
by decoding the run-length codes included in the 

20 data Dyi.i. In the following description, a reduced 
image data reproduced for the j-th scanning line in 
the i-th bit plane will be referred to as "drn", where 
the index F is Y. M, C and K. According to the 
symbol dR-j, the reduced image data first repro- 

25 duced is "dYi.t" having one bit per pixel. The data 
dYi.i is delivered to the buffer memory 27. to be 
stored therein. 

The display controller 28 reads out the data 
dYi-t fi'om the buffer memory 27 to display the 

30 reduced Y-image for one line on a first scanning 
line of the monitor display 29, where the displayed 
image is a binary image corresponding to a part of 
the first bit plane BPyi for the first scanning line. 
Since the first bit plane represents the most signifi- 

35 cant bits for the respective pixels, the binary image 
is a linear array of pixels having respective color 
density levels of "0" or "2^ = 128". For example, if 
the reduced image for the first scanning line is 
expressed by a series of 8 bits: 

40 [ 10000000 ] 
[ 11000000 ] 
[ 10100000 ] 
[01000000 ] 
[ 001 00000 ] 

45 

the reduced image currently displayed on the basis 
of the data dYi-i is linear pixel array in which the 
respective Y-color densities on the pixels are ex- 
pressed as; 

50 "128". "128". "128". "0", "0".... 

The Y color densities indicated above are 
schematically shown in Rg. 11 as bars indicated 
with the symbol "BPyi". 

The process of displaying the line image on 

55 the first bit plane is repeated in series also for 
other colors M, C and K. More particulariy. the 
decoder means 34M (34C. 34K) read out the data 
Dmi-i (Dci-i. Dki-i) from the buffer memory 25M 
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(25C, 25K) and decodes the run-iength codes in- 
cluded therein, whereby image data dMi.i (dci-i. 
dtci.i) on the first scanning line in the first bit plane 
are reproduced as those having one bit for each 
pixel. 

Every time the image data dMi-i (dci-i. dkio) 
are reproduced, the data are stored in the buffer 
memory 27. The data dwi-i (dci-i. dki-i) are then 
read out with the display controller 28. and the 
reduced linear image for M (C. K) color is dis- 
played on the first scanning line of the monitor 
display 29 together with other color component(s) 
being already displayed. Therefore, when all of the 
color components for the first scanning line in the 
first bit plane are reproduced, a linear full color 
image having a rough color gradation is obtained 
on the first scanning line of the monitor display 29. 

The process indicated atjove is repeated in 
series for te second through last scanning lines, 
and. when the reproduction of the first bit plane for 
all of the scanning lines is completed, a reduced 
full color image having a rough color gradation is 
being displayed on the color monitor display 29. 
Fig. 12A is an example of the currently displayed 
image, which is an image having a rough color 
gradation as compared with the color image of 8 
bits shown in Rg. 12E since only respective most 
significant bits for pixels are used for the display. 

Then, the reduced and compressed image data 
Dpz-i (F = Y. M, C and K, j = 1-512) in the second t>it 
plane are decoded in series, and the decoded 
image are displayed on the monitor display 29 
while being overlapped or composed with the re- 
duced image corresponding to the first bit plane. 
With respect to the Y-component. for example, the 
respective color densities of pixels in the compos- 
ite image are expressed by the composite bars of 
BPY1 and BPY2 shown in Rg. 11. Since each of 
the composite gradation levels is expressed by the 
combination of the most significant bit and the 
second significant bit. the currently displayed im- 
age shown in Rg. 126 has a color gradation whose 
fineness Is superior to that of the image shown in 
Rg. 12A. 

The above-indicated process is repeated also 
for the third through eighth bit planes, and the 
reduced image displayed on the monitor display 29 
Is increased step by step in its fineness of grada- 
tion, since the number of bits used for the display 
increases one by one from the most significant bit 
to the least significant bit. For example, the grada- 
tion levels including the most significant bit through 
the third significant bit, i.e.. the first through third 
bit planes, are expressed the composite bars of 
BPv,. BPy2 and BPys as shown in Rg. 11, and the 
fineness are further increased as compared with 
the image expressed only by BPyi and BPyz. Rg. 
12C through Rg. 12E show the increase of the 
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gradation fineness responsive to the accumiation of 
bits in each pixel. When all of the bit planes for the 
reduced image have been reproduced to be com- 
bined with each other for the display, the color 

5 image on the monitor display 29 has full gradation 
of 8 bits, and the reduced image can be fully 
recognized by the user, as shown in Rg. 12E. It is 
to be noted that the decoding for reproduciton of 
the reduced image is conducted in time series for 

70 the bit planes, the respective images shown in Rg. 
12 appear on the monitor display 29 step by step. 
In other words, a reduced image having relatively 
rough gradation can be observed prior to the full 
gradation image. 

75 The user observes the monitor display 29 on 

which the reduced image gradually gets its grada- 
tion. When it is found that the image being dis- 
played is not the desired image, the user inputs a 
cancellation command from the keyboard 26 to 

20 cancel the request for display, in response to the 
cancellation command, the sequence for the de- 
coding and the display is stopped, and no further 
process is conducted for the current image. Then, 
the user inputs another identification data from the 

25 keyboard 26 in order to further try to retrieve the 
desired image file from the image bank IB. The 
new identification data is transmitted to the image 
bank IB. and the image file designated by the 
identification data Is transmifted to the image termi- 
. 30 nal TM. and the process of decoding the run-length 
codes for displaying the reduced image is again 
carried out with respect to the transmitted new 
Image file. 

On the other hand, when the user finds at the 

35 display step of Rg. 12C. for example, that the 
reduced image being displayed is just the desired 
image, the user inputs a confirmation command 
from the keyboard 26. In response to the confirma- 
tion command, the decoding process and the dis- 

40 play process are stopped since the displayed im- 
age is already confirmed and no further display is 
required for image search, if neither the cancella- 
tion command nor the confirmation command is 
inputted, the decoding process and the display 

45 process continue until the reduced image in the full 
gradation appears on the monitor display 29. 

When the decoding process and the display 
process are stoppted due to the confirmaiton com- 
mand, the file header FH is accessed in order to 

50 find the information respecting the original image 
such as the size thereof. Then, the compressed 
original image data are read out in series from the 
image memory 24 for each scanning line and each 
color component, under the control by the 

55 read/write control means 32. The Y, M. C and K - 
components included in the compressed original 
image data are stored in the buffer memories 25Y- 
25 K, respectively. 



8 



15 



EP 0 327 931 A2 " ^ 16 



♦ 

A decoder means 36Y, which is included in a 
data reproduciton means 36 together with other 
decorder means 36M-36K, reads out the com- 
pressed original image data Oy.i (Fig. 10) for the 
first scanning line from the buffer memory 25Y. in 
order to decode the predictive codes included in 
the data Dy.i- When the decorded or reproduced 
original image data is expressed by a symbol 
"dfTj". where F = Y. M. C or K and j = 1 - N. the 
data which is reproduced first is "dY,i" having 8 
bits per pixel. 

The other decorder means 36M-36K are then 
enabled in series, to decode the respective predic- 
tive codes of the data Dm-i. Dc-i and Dk.i. respec- 
tively, whereby reproduced original image data dwi 
dci and dKi for the first scanning line are obtained 
in time series. The reproduced original image data 
or color components dyrdKi are stored in the im- 
age memory 24 in the form where the data dvi-dKi 
are correlated with the file header FH. 

the above-indicated process is repeated in se- 
ries also for the second through last scanning lines 
under the control by a data reproduction control 
means 36. whereby a sequence of the reproduced 
original image data: 
dvi-dKi. dY2-dK2» dyivrdKM 

are serially obtained and are so stored in the image 
memory 24 as to be correlated with the file header 
FH, Preferably, the sequence of the reproduced 
original image data are stored at the addresses 
next to that for the file header FH. The combination 
of the file header FH and the reproducted original 
image data can be used for an arbitrary image 
processing such as image receding, edition and 
the like. It is to be noted that the reproduced 
original image is not displayed on the monitor 
display 29 for image search, since it has been 
already found through the reduced image whether 
the image file transmitted from the image bank IB 
is the desired one or not. 



F. Advantage of the Preferred Embodiment 

According to the image communication system 
100. the desired original image is retrieved by 
observing the reduced image on the monitor dis- 
play 29. Since the reduced image is decreased in 
data amount as compared with the original image, 
the memory capacity of the display buffer memory 
27 may be relatively small. Furthermore, the whole 
of the reduced image can t5e displayed on the 
monitor display 29 simultaneously, and therefore, it 
is easily found whether the displayed image is the 
desired one or not. The reduced image can be 
expressed by relatively little amount of data, which 
is about 1 .6 percents of that for the original image, 
for example, and the transmission thereof does not 



require long time. Consequently, the time and the 
task required for image search is decreased. Since 
the reduced image is dedicated to the image 
search, the reduciton in image quality causes no 

5 problem. 

The compression of the reduced image data 
being in series of the bit planes is preferred for 
rapid image search. Before the full gradation of the 
reduced image is displayed, the user can judge 

10 whether the image file being accessed is a desired 
one or not. On the other hand, the data compres- 
sion for each scanning line is preferred for original 
image data expressing large original image such as 
that for printing process. This is because such a 

75 large original image requires a buffer memory hav- 
ing large storage capacity, e.g.. several hundred 
megabytes, when it is compressed for each bit 
plane. The required capacity of the buffer memc y 
is several hundred kilobytes, for example, in the 

20 case where the original image data is compressed 
for each scanning line. However, when the original 
image is relatively small in size, such as a televi- 
sion image, the original image data may be com- 
pressed for each bit plane, since only about one 

25 megabyte is required in the buffer memory. 

The image communication system 100 accord- 
ing to the preferred embodiment meets both of the 
* ' two requirements, one of which is the rapid image 
search and the other is the decrease of the mem- 

30 ory capacity and the data transmission time. Fur- 
thermore, when the reduced image is displayed, 
prior to or in parallel with the transmission of the 
original image data, the transmission of the original 
image data can be stopped at the time when it is 

35 found that the original image is different from the 
desired one. This is quite effective in an image 
communication system using a transmission path 
such as a telephone line whose transmission speed 
is relatively low. because a relatively long time is 

40 required until whole of the original image data is 
transmitted. 



G, Modifications in the Preferred Embodiment 

45 

The image communication system 100 de- 
scribed above can be modified into various modes 
as follows; 

(1) When it is desired to search the image 
so memory 4 for a desired original image at the inside 
of the image bank 16. the reduced image included 
in the image file may be displayed on tiie monitor 
display 9 provided in the image bank IB. In this 
case, the program for attaining the functions shown 
55 in Fig. 6 is stored in the image bank IB as well as 
the image terminal TM. If the functions shown in 
Rg. 5 are given to both of the image terminal TM 
and the image bank IB. a bidirectional image com- 
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munication between the image terminal TM and the 
image bank IB is realized, where an image trans- 
mission from the image terminal TM to the image 
bank IB is carried out in the process similar to that 
from the image bank IB to the image terminal TM. 

(2) The image terminal TM may decode the 
encoded image data in parallel with the data trans- 
mission from the image bank IB. where the trans- 
mitted data are delivered to the decorder means 
34Y.34K (36Y-36K) without substantial delay. If the 
storage capacity of the image memory 24 is rela- 
tively large, a plurality of image files may be trans- 
mitted from the image bank IB to be stored in the 
image memory 24. The user searches the image 
memory 24 for a desired image by displaying the 
respective reduced images in series. 

(3) The file header, the reduced image data 
and the original image data may be stored and/or 
transmitted in a form other than the serial storage 
and the serial transmission, as long as these data 
are correlated with each other. For example, these 
data may be stored and/or transmitted in parallel. 
The correlation between these data may be in- 
dicated by adding a common reference code to 
each of them. 

(4) For the data compression of the reduced 
image data and/or the original image data, another 
data compression rule may be used. When the 
original image data is a binary data, the image data 
may be converted into a run-length data through 
data compression using Modified Huffman Coding. 
The present invention can be also applied to a 
monochrome image. RGB color image and other 
images. The reduced image data may be so gen- 
erated as to have only the more significant bits, 
e.g.. 4-bits, for each pixel. In general, when the 
original image data is a gradation data expressing 
the original image with n bits (n = an integer larger 
than one) for each pixel, the*compression of the 
reduced image data may be carried out for i-th bit 
plane while incrimenting the integer i within the 
range 1 S i S m. where m is an integer 'satisfying 1 
^ m ^ n. The reduced and compressed image data 
only for the first through m-th bit planes are stored 
or transmitted. The preferred embodiment de- 
scribed above corresponds to the case where m = n 
( = 8). 

The reduced image data may be compressed 
through data compression for each scanning line, 
e.g., the predictive coding, rather than that for each 
bit plane. Although data compression for the re- 
duced image data and the original image data is 
preferred for further saving the memory capacity 
and the data transmission time, the data compres- 
sion may be omitted in the image communication 
system 100. 

Accordingly, the present invention may be em- 
bodied as various image files, as shown in Rg. 13 - 



Rg. 18. An image file IF2 has the most basic 
structure, and comprises a file header, a reduced 
image data and an original image data correlated 
with each other. Since it is not necessary to com- 

5 press the reduced image data and the original 
fmage data, a process of producing and transmit- 
ting the image file IF2 is simplified as compared 
with the image file IFi shown in Rg. 4A. 

The reduced image data and/or the original 

70 image data may be replaced by their respective 
compressed data in order to reduce the required 
memory capacity, examples of which are shown in 
Rg. 14 - Rg. 16 as image files IF3 -IF5. 

The reduced and compressed image data tn- 

75 eluded in the image files IF3 and IFs may be 
expressed in serial order of the bit planes, as 
emt5odied in image files IFsa and IFee- On the other 
hand, when the compressed original image data in 
the image files iF4. and IF5 is expressed in serial 

20 order of scanning lines, image files IF7A and IF7B 
are obtained, respectively. As will be understood 
by those skilled in the art. the image file IFi shown 
in Rg. 4A is obtained by combining the reduced 
and compressed image data in the image file IFsa 

25 or IFes with the compressed original image data in 
the image file IF7A and IF7B. The respective advan- 
tages of the data compression in serial order of bit 
planes and that in serial order of scanning lines are 
already described, and therefore, a redundant de- 

30 scription is omitted here. 

Although the present invention has been de- 
scribed and illustrated in detail, it is clearly under- 
stood that the same is by way of illustration and 
example only and is not to be taken by way of 

35 limitation, the spirit and scope of the present inven- 
tion being limited only by the terms of the appen- 
ded claims. 

The features disclosed in the foregoing de- 
scription, in the claims and/or in the accompanying 
40 drawings may, both, separately and in any com- 
bination thereof, be material for realising the inven- 
tion in diverse forms thereof. 



45 Claims 

1. A method of storing an image file in a 
memory means which is provided in an image 
processing system /having an image display usable 
50 for image search, said method comprising the 
steps of: 

(1) preparing a first image data expressing 
an original image. 

(2) generating a second image data express- 
55 ing a reduced image of said original image, size of 

said reduced image being equal to or smaller than 



display size of said image display. 
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(3) producing a file header including an iden- 
tification data for identifying said image file, and 

(4) storing a combination of said file header, 
said first image data and said second image data 
in said memory means as said image file. 

2. A method in accordance with claim 1. 
wherein 

the step (2) includes the step of: 

(2-1) generating a reduced image data ex- 
pressing said reduced image for each pixel, and 

(2-2) compressing said reduced image data 
to generate a reduced and compressed image data 
as said second image data, 

3. A method in accordance with claim 2. 
wherein 

the step (1) includes the steps of: 

(1-1) preparing an original image data ex- 
pressing said original image for each pixel and 

(1-2) compressing said original image data 
to generate a compressed original image data as 
said first image data. 

4. A method in accordance with claim 3, 
wherein 

the step (2-1 ) includes the step of: 

(2-11) taking a weighted average of said 
original image data every two or more pixels to 
generate said reduced image data. 

5. A method in accordance with claim 4, 
wherein 

said original image data is a gradation data ex- 
pressing said original image with n bits for each 
pixel, where n is an integer larger than one, 
said reduced" image data includes a plurality of n 
bit data expressing gradation of said reduced im" 
age for each pixel and 

the step (2) is conducted in serial order of bit 
planes of said reduced image data. 

6. A method in accordance with claim 5, 
wherein 

the step (2-2) includes the steps of: 

(2-21) extracting respective i-th significant 
bits from said plurality of n bit data, where i is an 
integer, " 

(2-22) compressing a bit plane consisting of 
said respective i-th significant bits to generate i-th 
compressed data, and 

(2-23) repeating the steps (2-21) and (2-22) 
while incrimenting i from one to m, where m is an 
integer satisfying 1 5 m S n, said reduced and 
compressed image data including said i-th com- 
pressed data for all of i satisfying l ^ i ^ m. 



7. A method in accordance with claim 6, 
wherein the integers m and n are identical with 
each other. 

8. A method in accordance with claim 7, 
5 wherein the step (2-22) includes the step of: 

encoding said bit plane into run-length codes. 

9. A method in accordance with claim 8, 
wherein a plurality of scanning lines are defined on 
said original image. 

10 the step (1-2) Includes the step of: 

(1-21) compressing said original image data 
in serial order of scanning lines. 

10. A method in accordance with claim 9, 
75 wherein the step (1-21) includes the step of: 

encoding said original image data in accordance 
with a predictive coding rule. 

1 1 . A method of transmitting an image data to 
an image processing system through a transmis- 

20 sion path in the form of an image file, said image 
processing system having an image display usable 
for image search, said method comprising the 
steps of: 

(1) preparing a first image data expressing 
25 an original image, 

(2) generating a second image data express- 
ing a reduced image of said original image, size of 
said reduced image being equal to or smaller- than 
display size of said image display. 

30 (3) producing a file header including an iden- 

tification data for identifying said image file, and 

(4) transmitting a combination of said file 
header, said image data and said second image 
data to said image processing system, through 

35 said transmission path as said image file. 

12. A method in accordance with claim 11. 
wherein the step (2) includes the steps of: 

(2-1) generating a reduced image data ex- 
40 pressing said reduced image for each pixel, and 

(2-2) compressing said reduced image data 
to generate a reduced and compressed image data 
as said second image data. 

4S 13. A method in accordance with claim 12, 

wherein the step (1) includes the steps of: 

(1-1) preparing an original image data ex- 
pressing said original image for each pixel, arKl 

(1-2) compressing said original image data 
50 to generate a compressed original image data as 
said first image data. 

14. A method in accordance with claim 13, 
wherein the step (2-1) includes the step of: 
55 (2-11) taking a weighted average of said 

original image data every two or more pixels to 
generate said reduced image data. 
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15. A method in accordance with claim 14. 
wherein said original image data is a gradation data 
expressing said original image with n bits for each 
pixel, where n is an integer larger than one, 

said reducecT image data includes a plurality of n 
bit data expressing gradation of said reduced im*^ 
age for each pixel, and 

the step (2-2) is conducted in serial order of bit 
planes of said reduced image data. 

16. A method in accordance with claim 15. 
wherein the step (2-2) includes the steps of: 

(2-21) extracting respective i-th significant 
bits from said plurality of n bit data, where i is an 
integer. " 

(2-22) compressing a bit plane consisting of 
said respective i-th significant bits to generate i-th 
compressed data, and 

(2-23) repeating the steps (2-21) and (2-22) 
while Incrimenting i from one to m. where mis an 
Integer satisfying 1 ^ m ^ n. said reduced and 
compressed image data including said i-th com- 
pressed data for all of I satisfying 1 :£ i :S m. 

17- A method in accordance with claim 16. 
wherein the integers m and n are identical with 
each other. * 

18. A method in accordance with claim 17. 
wherein the step (4) includes the steps of: 

(4-1) transmitting said file header and said 
reduced and compressed image data to said image 
processing system, and 

(4-2) transmitting said compressed original 
image data to said image processing system after 
the step (4-1) is completed. 

19. A method in accordance with claim 18, 
wherein the step (4-1 ) includes the steps of: 

(4-11) transmitting said file header to said 
image processing system, and 

(4-12) transmitting said I-th compressed data 
for all of i satisfying 1 ^ i ^ m to said image 
processing 'system in an ascent order of i. 

20. An image search system useful for search- 
ing an image file for a desired original image, said 
system comprising the steps of: 

(1) an image display having a display plane, 

(2) means for generating a first image data 
expressing a given original image, 

(3) means for generating a second image 
data expressing a reduced image of said original 
image, size of said original image being equal to or 
smaller than size of said display plane, 

^4) means for generating a file header includ- 
ing an identification data for identifying said image 
file. 
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(5) memory means for storing a combination 
of said file header, said first image data and said 
second image as said image file, and 

(6) means for reading out said second image 
5 data from said memory means to deliver said sec- 
ond image data to said image display, whereby 
said reduced image is displayed on said display 
plane for image search. 

70 21. An image search system in accordance 

with claim 20, wherein 
said means (3) includes: 

(3-1 ) means for generating a reduced image 
data expressing said reduced image for each pixel. 
75 and 

(3-2) means for compressing said reduced 
image data to generate said second image data. 

22. An image search system in accordance 
20 with claim 21 . wherein 

said original image is a gradation data expressing 
gradation of said original image for each pixel, 
said reduced image data includes a plurality of n 
bit data expressing gradation of said reduced cm- 
25 age for each pixel, where n is an integer larger 
than one, and " 
said means (3-2) comprises: 

(3-21) means for extracting respective i-th 
significant bits from said plurality of n bit data, 
30 where i is an integer, 

(3-22) means for compressing a bit plane 
consisting of said respective i-th significant bits to 
generate i-th compressed data, and 

(3-23) means for enabling said means (3-21) 
35 and (3-22) while incrimenting i from one to m, 
where m is an integer satisfying l ^ m S n, said 
second image data including said I-th compressed 
data for all of i satisfying 1 ^ i ^ m. 

40 23. An image search system in accordance 

with claim 22, wherein 
said means (6) includes: 

(6-1) means for delivering said i-th com- 
pressed data for all of i satisfying 1 ^ i 2 m to said 
45 image display in an ascent order of i, whereby 
gradation of said reduced image displayed on said 
display plane becomes fine step by step. 

24. An image search system in accordance 
50 with claim 23, further comprising: 

(7) means for disenabling said means (6-1) 
in response to a command signal inputted into said 
image search system. 

55 25. An image search system in accordance 

with claim 24, further comprising: 

I 
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(8) means for receiving said first image data, 
said second image data and said file header from 
said means (2). (3) and (4), respectively. 

(9) means for transmitting said file header, 
said second image data and said first image data 
from said means (8) to said means (5) in that order. 

(10) means for inputting said command sig- 
nal with manual operation, and 

(11) means for disenabling said means (9) in 
response to said command signal. 
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